fahad-ebrahim

Fahad-ebrahim's group workspace

Group: Single Adapter

1-1

of 1

Tags

Notes

Author

fahad-ebrahim

State

Crashed

Start time

May 20th, 2024 10:20:56 AM

Runtime

22m 30s

Tracked hours

20m 35s

Run path

fahad-ebrahim/IRC RoBERTa Adapters/pmhy4i8m

Linux-6.5.0-28-generic-x86_64-with-glibc2.35

Python version

3.10.12

Command

workspace/SingleAdapter_AdaptIRC_V2_(1)_(1).ipynb

System Hardware

CPU count	24
Logical CPU count	48
GPU count	1
GPU type	NVIDIA GeForce RTX 4090

W&B CLI Version

0.17.0

Group

Single Adapter

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 194 keys
- _name_or_path:
  "roberta-base"
- ▶
  accelerator_config:{} 4 keys
  - dispatch_batches:
    null
  - even_batches:
    true
  - split_batches:
    false
  - use_seedable_sampler:
    true
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "RobertaForMaskedLM"
- attention_probs_dropout_prob:
  0.1
- auto_find_batch_size:
  false
- bad_words_ids:
  null
- begin_suppress_tokens:
  null
- bf16:
  false
- bf16_full_eval:
  false
- bos_token_id:
  0
- chunk_size_feed_forward:
  0
- classifier_dropout:
  null
- cross_attention_hidden_size:
  null
- custom_heads:{} 0 keys
- data_seed:
  null
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_persistent_workers:
  false
- dataloader_pin_memory:
  true
- dataloader_prefetch_factor:
  null
- ddp_backend:
  null
- ddp_broadcast_buffers:
  null
- ddp_bucket_cap_mb:
  null
- ddp_find_unused_parameters:
  null
- ddp_timeout:
  1,800
- debug:[] 0 items
- decoder_start_token_id:
  null
- deepspeed:
  null
- disable_tqdm:
  false
- dispatch_batches:
  null
- diversity_penalty:
  0
- do_eval:
  false
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  2
- eval_accumulation_steps:
  null
- eval_delay:
  0
- eval_steps:
  null
- vocab_size:
  50,265
- warmup_ratio:
  0
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 17 keys
- eval/f1:
  0.999333332666666
- eval/loss:
  0.0012785957660526035
- eval/precision:
  0.9993346640053228
- eval/recall:
  0.9993333333333332
- eval/runtime:
  3.8683
- eval/samples_per_second:
  387.77
- eval/steps_per_second:
  48.601
- total_flos:
  45,548,182,242,319,392
- train_loss:
  0.27522293273438797
- train_runtime:
  1,214.5554
- train_samples_per_second:
  247.004
- train_steps_per_second:
  7.739
- train/epoch:
  200
- train/global_step:
  9,400
- train/grad_norm:
  26.017210006713867
- train/learning_rate:
  0
- train/loss:
  0.0983

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-pmhy4i8m-history:v0

Fahad-ebrahim's group workspace

Single Adapter

AT_single_adapter_all